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A  PERSFt-rCT  1  OW  MULTIACCESS  CHANNELS 

1 .  iNTPQDUCTIQN 

- For  the  last  ten  years  there  have  been  at  least  three 

bodies  of  research  on  multiaccess  channels,  each  proceeding  .in 
virtual  isolation  from  the  others  and  each  using  totally 
different  models.  The  objective  here  is  to  contrast  these  bodies 
of  work  and  to  give  some  perspective  on  what  is  needed  to  provide 
some  unification  between  the  areas.  We  shall  refer  to  the  three 
areas’  as  collision  resolution,  multiaccess  information  theorv, 

and  spread  spectrum. - - 

The  kind  of  communication  situation  that  these  three  areas 
address  is  illustrated  in  fig.  l.i.  There  are  multiple 
transmitters  and  a  single  receiver.  The  received  signal  is 
corrupted  both  bv  noise  and  by  mutual  interference  between  the 
transmitters.  Each  of  the  transmitters  is  fed  by  an  information 
source,  and  each  information  source  generates  a  sequence  of 
messages,  successive  messages  arriving  at  random  instants  of 
time.  There  is  usual Iv  some  small  amount  of  feedback  from  the 
receiver  to  the  transmitter,  but  this  feedback  will  not  be  our 
main  focus.  Q».ir  major  focus,  rather,  is  on  the  interference,  the 
noise,  and  the  random,  or  "bursty”,  message  arrivals. 

This  tvpe  of  model  is  aporooriate  for  the  uplink  of  a 
satellite  network,  for  a  radio  network  where  there  is  one  central 
repeater,  and  for  the  traffic  to  the  central  node  on  a  multidrop 
telephone  line.  It  is  also  adequate  in  most  respects  for 


tudvina  networks  where  a  common  channel  allows  all  nodes  to  hear 


all  OTzhcar  nodes.  Common  examples  are  a  cable  connect!  no  many 
nodes  and  a  fully  connected  radio  network. 

The  beginning  of  the  collision  resolution  approach  to 
multiaccess  communication  came  in  1970  with  Abramson's  Aloha 
network  Cll.  The  idea  here  was  that  whenever  a  message  (or 
oacketJ  arrived  at  a  transmitter,  it  would  simply  be  transmitted 
ignoring  all  other  transmitters  in  the  network.  If  another 
transmitter  was  transmitting  in  an  overlapping  interval,, 
interference  would  prevent  the  message  from  being  correctly 
received,  the  cvclic  redundancy  check  (CRC)  would  not  check,  no 
acknowledgement  would  be  sent,  and  the  transmitter  would  try 
again  laterj  the  later  time  would  be  pseudorandoml y  chosen  to 
avoid  the  certainty  of  another  collision  if  both  transmi tters 
waited  the  same  time. 

Over  the  vears.  this  basic  strategy  has  been  improved, 
generalised,  and  analycad  in  many  wavs.  A  number  of  varjations 
are  in  widespread  use,  and  the  general  topic  of  collision 
resolution  has  provided  many  challenging  and  interesting  problem; 
for  research.  Section  4  provides  an  introduction  to  these 
problems  and  most  of  the  other  papers  in  this  special  issue  are 
devoted  to  the  current  state  of  these  problems. 

Collision  resolution  researcli  has  always  focused  on  the 
bursty  arrivals  of  messages  and  the  interference  between 
transmi t ters .  but  has  generally  ionored  the  noise.  More 
generally,  this  approach  ignores  the  underlying  communication 
process,  assuming  only  that  a  message  transmission  is  correctly 
received  in  the  absence  of  collision  and  incorrectly  received 


tiven  without  source  cod  i  no,  if  the  arrival  process  is  ernodic, 
then  over  the  arbitrarily  long  time  intervals  used  in  the  coding 
theorems,  the  bursty  arrivals  will  not  matter. 

From  a  more  practical  point  of  view,  the  sinaie  user  liinit 
theorems  of  information  theory  are  interesting  both  because  thev 
put  an  upper  limit  on  what  is  achievable  and  because  the  limit  i  =■ 
usuallv  not  too  far  from  what  is  oracticallv  achievable.  For  a 
multiaccess  channel,  however,  the  long  time  intervals  required 
ror  the  source  arrivals  to  appear  smoothed  out  are  typically  far 
greater  than  tne  tolerable  delavs.  Con'^ersely.  the  time  interval 
required  for  coding  to  be  effective  (ie.  the  time  for  the  noise 
to  be  smoothed  out)  is  typically  smaller  than  the  tolerable 
delay.  What  is  needed  then  is  an  information  theoretic  modei 
that  somehow  precludes  the  possibility  of  imposing  long  delavs  on 
source  messages. 

One  approach  to  this,  which  is  used  in  the  collision 
resolution  field,  is  to  assume  an  infinite  number  of  sources,  or 
euui val ent i V .  chat  a  new  transmitter  is  created  for  each  new 
arriving  message  and  then  destroyed  when  the  message  is 
successfully  transmitted.  The  received  sequence  or  waveform  would 
tiien  be  some  function  of  noise  and  whatever  was  being  transmi  t  ted 
by  the  active  transmitters.  It  seems  that  to  develop 
understanding  in  this  area,  it  is  necessary  first  to  develop  some 
understanding  of  coding  (as  apposed  to  coding  theorems)  in  a 
multiaccess  environment.  This  understanding  should  involve 
decoding  in  the  presence  of  several  messages  being  transmitted 
simultaneously,  since  otherwise  the  problem  simplv  reduces  to 


contlict  resolution  with  codinq  added  -for  reliable  transmission 
in  the  absence  ot  conflicts. 

In  section  2,  we  discuss  multiaccess  information  theory  in 
more  detail,  and  in  section  3,  we  discuss  what  little  is  known 
about  coding.  In  both  sections,  the  discussion  is  restricted  to 
systems  with  only  two  sources.  The  rationale  for  this  is  to 
unoerstand  multiacess  coding  in  the  simplest  content  before 
tackling  the  problem  of  real  interest  with  many  sources  and 
transrni  tters. 

The  spread  spectrum  approacn  to  multiaccess  channels  C7,83 
will  not  be  discussed  in  anv  detail  in  this  paper,  but  is  briefly 
discussed  here  in  order  to  illustrate  the  types  of  possibilities 
for  multiaccess  communication  that  lie  outside  the  conventional 
collision  resolution  and  codinq  theory  approaches.  Spread 
spectrum  is  a  mode  of  communication  originally  developed  to 
protect  against  jamming  in  a  military  environment.  The  signal  to 
be  transmitteo  is  modulated  over  a  much  broader  frequency  band, 
sav  p  times  more,  than  necessary.  Hssuminq  that  the  jammer  does 
not  know  the  modulating  sequence,  the  jammer’s  signal  will 
essentially  iooi-..  like  broad  band  noise  to  the  signal,  and  the 
noise  seen  bv  the  receiver  after  demodulation  will  be  reduced  bv 
a  Tact or  ot  p. 

For  multiaccess  communication  using  spread  spectrum,  several 
sources  can  transmit  at  once  using  different  modulating 
sequences,  and  each  will  look  like  broad  band  noise  to  the 
others.  If  we  compare  this  type  of  system  to  frequency 
multiplexing,  using  p  frequency  bands,  it  appears  at  first  that 


spread  spectrum  is  not  a  very  good  idea.  When  p  transmitters 
transmit  together  using  spread  spectrum,  the  self  noise  becomes 
considerable,  and  the  resulting  system  is  clearly  inferior  to  FDM 
in  terms  of  capacity.  The  problem  with  FDM,  however,  is  that  if 
there  are  many  more  than  pi  transmitters  in  the  system,  but 
typically  many  fewer  than  p  with  messages  to  send,  there  is  a 
problem  allocating  the  frequencies  to  the  busy  transmitters  (this 
is  the  same  fundamental  problem  handled  by  the  collision 
resolution  approach).  Since  many  times  more  than  p  modulation 
sequences  can  be  chosen  that  are  almost  orthogonal  and  look  like 
noise  to  each  other,  spread  spectrum  provides  an  automatic 
solution  to  the  problem  of  allocating  the  channel  to  the  busy 
users.  This  solution  is  not  entirely  satisfactory,  since  one 
still  needs  collision  resolution  when  too  many  transmitters  send 
at  once,  and  the  decoding  is  very  complex.  It  illustrates, 
however,  a  major  point  of  this  paper  -  namely  that  a  better  set 
of  models  and  approaches  are  needed  for  multiaccess  commufii cat i on 
than  collision  resolution  or  information  theory  alone. 


The  Inrormation  Theoretic  Hooroacn 


Tne  coding  theorems  of  in-formation  theory  treat  the  question 
o-f  how  much  data  can  be  reliably  communicated  -from  one  point,  or 
set  ot  points,  to  another  point,  or  set  o-t  points.  It  is  tacitly 
assumed  that  the  sources  have  a  never  empty  reservoir  of  data  to 
send.  Thus  the  theoretical  results  in  this  area  do  not  address 
the  question  of  the  delav  that  arises  in  multiaccess  systems 


because  of  che  random  arrival  times  of  data  to  be  transmitted. 

The  class  of  channels  to  be  considered  is  illustrated  in 
Fig.  2.1.  Each  unit  of  time,  the  first  transmitter  sends  a 


symbol  from  an  alphabet  X  and  the  second  transmitter  sends  a 
symbol  w  from  an  alphabet  W.  There  is  an  output  alphabet  Y  and  a 
transmitter  probability  assignment  P<v|kw)  determining  tne 
probabilicv  of  receiving  each  vsY  for  each  choice  of  inputs  ftsX. 
and  wsW.  The  channel  is  memory  less  in  the  sense  thiat  if  x  - 

. Wj.j)  and  w  =  (w-  . .  .  .  reoresenc  the  inputs  to 

transmitters  one  and  two  resoecti  vel  v  over  f-4  successive  time 
ucijcs.  then  the  probability  of  receiving  y  =  ( y  ^  , .  .  .  ,  V|-^^  for  tne 
given  x,w,  is 


F'fyjxw)  = 


TT  F  (.  V  w  / 
,  n  '  n  n 
n  =  l 


(.2.1) 


We  assume  for  the  time  being  that  the  alphabets  are  all  discrete, 
but  it  will  soon  be  obvious  that  this  can  be  generalised  in  the 
same  wav  as  for  single  input  channels. 

As  indicated  in  the  figure,  there  are  two  independent 
sources  which  are  encoded  independently  into  the  two  channel 


inputs.  Consider  block  codinq  with  a  given  block  length  N  using 

M  code  words.  . Xl-.|> ,  tor  transmitter  1  and  L  code  words 

t-w^ . .  .  ,  .W|_j'  tor  transmitter  2:  each  code  word  is  a  seauence  of  N 
channel  incuts.  For  convenience  we  reter  to  a  code  with  these 

parameters  as  an  (N.it.L)  code.  The  rates  of  the  two  sources  are 
defined  as 


=  (In  M)/N.  R_  =  (In  L) /N 


(2.2) 


Each  N  units  of  time,  source  1  generates  an  integer  m  uniformlv 
distributed  from  1  to  It  and  source  2  independently  cenerates  an 
integer  H  uniformlv  distributed  from  1  to  L.  The  transmitters 
send  and  w^  respect i vel v ,  and  the  corresoondi ng  channel  oucpu' 
y  enters  the  decoder  and  is  mapped  inco  a  decoded  "message" 

It  boch  m  =  m  ana  li  *  H .  the  decoding  is  correct  and  otherwise  a 
decod  i  no  gi  i  ot  occurs.  The  probabi  1  i  tv  of  decodina  error,  p  i<^ 
minimized  for  each  y  by  a  maximum  liKeiihood  decocer.  choosina 
(m.y;  as  integers  1<  m'  <  l-l.  1  i  <  L  thar  ma:?imi::c 
'V  ^  ma:;imum  is  non-unique,,  anv  ma!:imizing 

wn'.li';  can  be  chosen  with  no  effecr.  on  P^.  Doth  sets  of  code 

words  IX I  .  .  .  .  ,X|,iJ  and  iw^ . W|_>  are  known  to  the  decoder,  cut. 

ot  course,  the  source  ouupucs  m.i'  are  unknown. 

I  he  most  fundamental  result  about  these  channels  is  the 
coding  theorem  due  to  Pihl  swede  C2]  and  Liao  [3J.  Let  Q^C:)  and 
Q2(w)  be  probability  assignments  on  the  X  and  W  input  alphabets 
respectively.  Define  the  acnievable  rate  region  R  as  the  convex 
hull  of  the  set  of  rate  pairs  (R^.R^)  which,  for  some  choice  of 
<**=si gnmen ts  satisfy  each  of  the  inequalities! 


(2 


Rj  +  R„ 


I  ( XW;  Y>  = 


L 

; :  ,  w ,  y 


Q  ,  <i<  )Q._,  (w)  F '^v  uw.'ln 

i  £. 


R  t  V  I ;;  w  I 
P  ( y ) 


F(yl;!w) 

0  <  Rj  i  I(X;y|W)  =  2  <;< )  Q_  ( w)  P  < y  I N w)  1  n  - 

!<?w,y  *■  F'(y|w>  (2.4/ 


_  F'  ( V  I  jf  w ) 

O  i  R.  <  j:(W;VjX>  =  2  tl!^  (:; )  Q.^  (w>  P  ( V  I  :;w/ 1  n  - 

!■; ,  w ,  V  P  ( y  j  :■;  /  (2.5) 

where  f"'(y;  =  i.:; )  Q2  ( w)  F' (y  };;w/ ,  Pw|w/  =  I.,  i.k  /  P  i.v  |kw/ ,  ana 

i-'  ( V  I  )< !  =  Q  -;,  ( w  /  F'  V  y  j  w  >  . 

The  reqion  bounded  by  (2.3)-(2.5)  for  a  given  Gi^  .Q.-  is  shown 
in  -fig.  2.2.  It  is  easv  to  see  thac  the  break  points  o-f  the 
boundary  occur  at  R-  -  I(X;  Y  {W).  rv;  =  i'.<*:  Y)  and  at  =  .1.  <  A;  r/. 
R2  “  i(W;Y|A).  In  general  .  since  ana  w  are  independent, 

1  va;  r  jW/  i  i  (,a:  r/  with  equaiitv  irt  anu  w  are  also 
cona i ti onal 1 y  inueuendent  given  v. 

I’heorem  2,1  (.nhl  swede,  Liao;:  For  each  e  .>  0,  6  0,  (Rj^  ,RV;, )  e|^, 

there  exists  an  I'r^  such  that  tor  all  N  i  N^.  M  i  exp  L  < 

exp  WVR2-6/.  there  exists  an  (N.M.L)  code  with  P^  <  e.  For  each 
6  >  0  and  (Rj^,R2)i'R.  there  exists  e  >  «.)  such  that  Pg  2  e  for  all 
(N,M,L)  codes  with  M  >  exp  N(R^  +  6),  L  >  exp  N(R.;,+  6). 

In  effect,  the  theorem  savs  that  reliable  communication  is 
possible  for  source  rates  in  the  interior  of  the  achievable 


region  and  is  impossible  outside  at  the  achievable  region. 

Slepian  and  Woir  C9]  later  generalised  this  result  by  considering 
a  third  source  that  could  be  encoded  jointly  -for  both 
transmitters.  They  also  used  a  random  coding  argument  which 
showed  that  can  be  made  to  decrease  exponentially  with  N  and 
showed  also,  in  a  sense,  that  most  codes  have  this  behavior. 

Since  this  random  coding  argument  is  a  very  simple  extension  or 
random  coding  tor  single  input  channels  and  gives  a  great  deal  or 
insight  into  coding  -for  multiple  access  channels,  we  now  oo 
through  the  argument  tor  the  two  source  case. 

2.  1  H  Multiaccess  Coding  Theorem 

Let  Qj^(x)  and  Q2‘.w)  be  probability  assignments  on  tne  X  and 
W  alphabets  respectively  and  consider  an  ensemble  or 
codes  where  each  code  word  x,„.  1  i  m  <  H.  is  i naeoendentl  v 
selected  according  to  the  prooabilitv  assionment 


Gi  \  X  i 


ff  Gi^lx  >.  X  =  vx, 
n=--i  ■ 


.  .  ■  ^ 


and  each  code  woro  w^,.  1  <  i  L  is  independently  selected 


according  to 


Q^.  <  w )  = 


rr  Q,,  1  w  )  ,  w  =  \w I  . 
.1  ^  n  A  * 

n  =  l 


<  2 . 7 ) 


For  each  code  in  the  ensemble,  the  decoder  uses  maximum 
likelihood  decoding,  and  we  want  to  upper  bound  the  expected 
value  Pg  of  Pg  for  this  ensemble.  Define  an  error  event  to  be  of 


type  1  if  the  decoded  pair  and  the  original  source  pair 

(m,!')  satisfy  m  f  m,  fl  =  C.  An  error  event  is  type  2  if  m  =  m 
and  ii  F  1},  and  is  of  type  3  if  m  F  m  and  i0  «.  Let  ,  1  i  i 

3,  be  the  probability,  over  the  ensemble,  of  a  type  i  error 
event?  obviously  P_  =  F'  ,  +  +  p 

Consider  P^^  first.  Note  that  when  <m,iJ)  enters  the 
encoder,  there  are  M-1  choices  for  m  and  (L-1)  choices  for  C,  or 
(i'i-1)  (L-1)  pairs,  that  yield  a  type  3  error.  For  each  such  pair 
(m,  i0),  the  code  word  pair  Wjj  is  stati  stical  1  v  independent  of 

*’*m-  the  ensemble  of  codes.  Thus,  regarding  (x,w)  as  a 

combined  input  to  a  single  input  channel  with  input  alphabet  X;:W 
we  can  directly  apply  the  coding  theorem,  theorem  5.6.1  of  ClOl, 
which  asserts*  that  for  all  p,  0  <  f  <  1, 


P 


^3  <  C  <M-1)  (L-1)  >  I  (x)Q2(w/Pvy  |kw;  +  +  P  <2.8 


x .  w 


Using  the  product  form  of  Q^,  Q^,  and  P,  Eqs.  (2.1,  2.o,  2.7), 
and  the  definition  of  rates  in  (2.2),  this  simplifies  to 


* 


fhe 


statement  of  theorem  5.6.1  of 


CIO]  assumes  that  all  code 


words  are  chosen  independently,  but  the  proof  only  uses  pairwise 
independence  between  the  transmitted  word  (X|^,w)  and  each  other 
word  (Xi.w.. )  m  ^  m.  o.  F  t>. 


Pp,  T  -  exp  L  pN  (R  +R._,)  D  ^ 

j  y  Q  ( X  /  ( w )  P  ( y  1 X  w )  ^  ^  ^ 

1.. 

iT ,  w  *■ 

J  J 

Next  consider  «  the  probability  that  m  m  and  C  =  <1.  We 
first  condition  this  probability  on  a  particular  message  i2 
entering  the  second  encoder,  and  a  choice  of  code  with  a 
particular  transmitted  at  the  second  inout.  b'lven  we  can 

view  the  channel  as  a  single  input  channel  with  input  and  with 
transition  probabilities  P^ylX(„Wj,>. 

rt  maximum  likelihood  decoder  for  that  single  input  channel 
will  make  an  error  ^or  be  amoiguous)  it 

f" ‘-y  l^m.^Wj, )  i  least  one  m*-  m.  (2.10.' 

ill  nee  this  event  must  occur  whenever  a  type  1  error  occurs,  th-e 
probaoilitv  of  a  type  1  error,  conditional  on  Wj,  being  sent  is 
upperboundad  by  the  probabilitv  of  error  or  atnbiguitv  on  the 
above  single  input  channel.  Using  theorem  5.6.1  of  ClOl  again 
for  this  single  input  channel,  we  have,  ter  any  p ,  U  <  p  <  1, 


PCType  1  error  |w^jJ  <  ^ 

y 


y  (X;  P  (y  |xw  i 


1/  ( l  +  p; 


1  +  P 


(2. 1 1) 


faking  the  expected  value  of  (2.11)  over  Wn  and  then  usina  the 


"  ~ 


^2  =  IT 


hU  =  R,  +  R^. 
o  1  2 


■In  )  Q.^<w>  ^  Q  <:•;  > P  ( V  I :<w> 

y7w  LK 


l/(l+p;ll+p 


E  ,-(p.a)  =  -In  G'  (k)  )  Q-(w)Pr/  !< 

i.  i  i.  ^ 


1  /'  (  1  +  p  )  1  1  +  p 
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(2.  17 


(2.  16 


E  _  ^  p  .  G1 )  = 

ao  ' 


1  /  1 1  ■<•  p  >  1 1  p 


)  (3  ^  ( '/■  I  Q.,  i.  w  ^  P  ( V  I K  w  / 
iTw 
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The  behavior  at  the  ej-tpresei ons  E^^(p,i.3),  i  =  1,2,3,  is  the 
same  as  for  the  single  input  case.  In  particular  let  I^,i- 
1 , 2 ,  .3 ,  be  a i  ven  b v 


1  -  I  (  X  :  Y'  !  W )  ,  I  „  =  I  ( W ;  y  I  X  .  I  ^  =  I  (  X  W ;  T  ) 

i-  *w' 


( 2 .  2<j 


as  detined  in  (2. 3;  -  (2. 3)  .  Then  it  >  0,  the  tunction  E^^^(p,Q 
IS  cancave,  strictly  increasing  in  p,  and  positive  tor  p  >  0. 
Furthermore,  the  ma:;imum  of  E^^^  ( p,Q) -pR^^  ever  *3  <  p  li  i  i  s 
positive  and  decreasing  in  tor  >3  <  Rj^  •=;.  1^  (see  theorems  5.o. 
and  5.6.4  of  GIOI  tor  proots).  Theorem  2.2  then  asserts  that  i-r 
<  I  ,  i  =  1,2,3,  then  decreases  exponentially  with 
increasina  N. 


There  are  two  questions  we  want  to  explore  in  the  rest  at 


this  section.  First,  how  tight  is  this  bound  on  error 
probability,  and  second,  what  indication  does  it  give  ot  the 
practicality  ot  coding  for  multiaccess  channels.  To  explore  the 
question  ot  tightness,  we  first  interpret  the  terms  in 

(2.14)  . 

as  upper  bounded  in  (2.12),  is  the  error  probability 
that  would  result  if  a  "genie"  informed  the  decoder  about  the 
second  source  message  il.  This  genie  aided  error  probability  is 
also  clearly  a  lower  bound  to  P^,  so  that  when  type  1  errors  are 
the  predominant  cause  of  errors,  the  genie  aided  error 
probability  closely  approximates  P^.  Similarly,  the  bound  for 
Pp,;^;  is  the  conventional  single  input  random  coding  bound  for  a 
single  code  of  rate  using  combined  inputs  with  probability 

Qj^(x)Q2(w).  Our  conclusion,  then,  is  that  the  bound  on  P^  in 
theorem  5.2  is  quite  tight  for  the  given  ensemble  of  codes.  The 
problem,  as  we  shall  soon  see  through  a  set  of  examples,  is  that 
the  best  codes  are  not  always  representative  of  the  enseimbies. 

2.2  The  Collision  Channel 

Let  X  =  '(iO,!,...!;;}  and  W  =  tO,  1 , .  ,  .  ,KJ- .  We  regard  0  as  an 
"idle"  input.,  and  if  0  is  the  x  input  for  a  given  w  input,  then  y 
is  the  pair  (0,w).  Similarly  if  w=0,  the  output  is  (x,0). 

Finally  if  x  /  0  and  w  o,  the  output  y  is  a  special  symbol  c 
representing  "collision".  This  is  shown  in  fig.  2.3  for  K=2. 

First  consider  the  achievable  rate  region.  For  any  given 


Q  (X )  ,  Q2  <w)  1  it  is  easy  to  see  that,  conditional  on  the  output  y, 
the  two  inputs  are  statistically  independent;  thus  I(X;y|W)  = 


iLKsY)  and  the  set  of  rates  satisfying  (2.3)-(2.5)  forms  a. 
rectangle.  We  next  want  to  find  the  set  of  rates  so  that  (Z.c-)- 
(2.5)  is  satisfied  for  some  choice  of  Qj ,Q2«  It  should  be  clear 
from  symmetry  that  Qj  (k)  should  be  constant  for  all  x  .•••  U  and 
□.^(w)  should  be  constant  for  w  >  0;  thus  we  need  only  consider 
the  union  of  rates  satisfying  (2.3>-(2.5>  oyer  all  choices  of  the 
idl'^'  probabilities  0,(0)  and  Qo<0).  Fig.  2.4  shows  the  resulting 
union;  for  all  K  >  8,  the  set  of  rates  is  non-conyex  (the  non- 
conyexitv  for  certain  multi-access  channels  was  first  shown  bv 
Cll]).  The  conyex  hull  of  this  union  region  is  the  set  of 
achieyataie  rates  of 'theorem  2.1.  Theoredi  2.2  assures  us  that 
exponentially  decaying  error  rates  are  achieyable  in  the  interior 
of  the  union  region.  Anv  giyen  rate  pair  in  the  interior  of  the 
ccnyex  hull  is  on  a  straight  line  between  two  pairs  of  rates  each 
in  the  interior  of  the  union  region.  Bv  time  diyision 
multiplexing  between  codes  for  these  rate  pairs,  reliable 
communication  is  achieved  for  the  giyen  rate  pair.  Thus  theorem 
2.2  establishes  the^  positive  half  of  theorem  2.1. 

It  is  rather  surorising  at  first  that  the  union  region  is 
nan--convex.  We  note  that  I(XW;Y)  is  a  concave  function  of  Qj(x) 
and  a  concave  function  of  Q2<x),  but  is  non-concave  as  a  joint 
function  of  and  Q- .  ,  It  is  also  concave  as  a  function  of 
Q',x,w/,  but  the  set  of  probability  vectors  Q(x.w)  for  which 
Qix.w)  =  Q.|(x)Qo(w)  for  some  is  a  non  convex  region.  Thus 

maximising  I(XW;Y)  over  and  Q2  can  be  viewed  either  as  a  non- 
concave  maximisation  or  a  concave  maximisation  over  a  non-convex 
reoion.  Either  wav,  multiple  isolated  extrema  can  exist  and 
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there  is  no  analog  of  the  Ari moto-Bl ahut  C12:,C133  algorithm  that 
can  be  used  to  find  the  achievable  rate  region. 

It  also  might  be  surprising  that  the  achievable  region  for 
the  collision  channel  is  not  achieved  by  mul  t  i  pi  e:;  i  ng  between 
Qj  (O)  =  U.  ~  I  ^nd  Qj  (0)  =  1,  =0  (.  i.e.  bv  one  user  or 

the  other  "using"  the  channel  while  the  other  is  idle).  The 
reason  is  that  the  choice  of  whether  or  not  to  be  idle  also 
convevs  information,  and  the  mul  tip  1  es;  i  ng  solution  (although 
eminently  prar-cical  for  large  K)  loses  this  e!!tra  information. 

Next  consider  the  achievable  error  probabilities  for  the 
CO  i.  .1.  i  si  ori  channel.  In  general,  for  an  input  distribution  G?(;<,w) 

=  Gi|  (.!•?)  Q.2  (w)  .  we  can  express  theorem  2.2  in  the  form; 

i  3  expC-N  ;]  (2.21) 

where  ^with  Rr  =  R ^ , 

R  ^  ( R .  ,  h' .  Q )  =  m  i  n  m  a  x  C  £  <.  p .  Q  .<  -  pR-  j  \  2 . 2  2 

i<i<3  Od;P<l  ’• 


In  principle  ( I'! ^  . R.-, , tii /  can  be  maximized  over  product 

d  1  s  t  r 1 b  u  t i on s  Q  , 


E 

r 


(R, ,R.) 

J.  4*.. 


max 

y. 


E 

r 


Q)  , 


V  2 . 20  ' 


and  this  in  principle  creates  an  exponent  of  error  decay  for  each 
Rj-Rz  in  the  union  region  of  fig.  2.4.  The  same  kinds  of 


problems  exist  in  performing  this  maximi^atian  as  exist  in 
finding  the  feasible  region  R.  Note  now  that  if  we  want  to 
achieve  a  given  exponential  decay  «,  and  if  there  are  two  rate 


pairs,  say  r|,R2  and  such  that  E^iRj,R2)  2:  «  and  E^iR']|,R2) 

>  «,  then,  for  any  rate  pair  Rj^.R^ 

R'l  =  XRJ  +  (l-X)R'j';  R^  =  XR^  +  (l-X)R,';  (2.24) 


with  0  <.  X  <  1,  an  exponent  of  a  or  more  can  be  achieved,  in  a 
sense,  by  time  snaring  between  equal  block  length  codes  for  R2^,R2 
and  for  R^.R.".  using  the  first  code  a  fraction  X  of  the  time  and 
the  second  a  fraction  (1-a)  of  the  time. 

This  means  that  we  can  detvne  a  region  R,_^  of  rate  pairs  as 
the  convex  hull  of  all  pairs  >  0.  R2  2:  0  for  which 

t^(R|,R;..-i  't  a.  Hs  «  increases  from  O,  R^  shrinks  from  the 
feasible  region  R  down  to  the  origin. 

There  are  se'/eral  other  approacnes  to  defining  a  random 
cooing  exponent  as  a  function  of  R^.R^,.  First,  the  random  coding 
ensemble  ii-.seit  could  use  different  probability  assignments  '3 , 
on  different  letter<5  of  the  block.  This  would  lead  to  the 
functions  in  (2.15)  and  (2.22)  being  replaced  by 

weicihted  a'^erages  between  tne  different  choices  of  Q,  as 


oi 


,  Q 


(  .1.  / 


Q 


(2) 


At  .  1  (:• ,  k  > 

01  • 


(i-x)£  . (p,a  / 

01  '  ’ 


ut.  .to; 


No  examples  have  been  found  where  this  approach  enlarges  the 
regions  R^^  defined  above;  this  approach  is  sufficient,  however, 
to  achieve  exponential  decays  in  F'  for  all  rate  pairs  in  the 


Another  approach  is  to  consider  random  coding  ensembles  in 
which  successive  letters  are  statistically  dependent.  For  the 
collision  channel,  for  example,  suppose  the  block  is  divided  into 
sub-blocks  o-f  -four  letters  each.  Within  each  sub-block,  we 
choose  (k  to  have  either  the  t'orm  lx, K, 0,0)  or  the 

form  <0,0,x.;!).  each  with  equal  probabi  1  i ’ly .  Similarly, 

,w.^, W',.;, W4)  has  either  the  form  (w.0,w,0)  or  (0,w,0,w)  with 
equal  probability.  Finally,  x  and  w  are  independently  and 
equiprobably  chosen  from  •£  1  . 2 ,  .  .  .  , K)  .  With  this  arrangement, 
each  sub-block  of  length  4  is  equivalent  to  a  noiseless  x  channel 
with  2K  inputs  and  a  noiseless  w  channel  with  2K  inputs  (this 
example  was  suggested  by  Massev's  coding  scheme  for 
unsvnchroni 7.ed  collision  channels  1114]).  The  resulting  random 
coding  exponent  is  clearly  larger  than  that  where  the  successive 
letters  are  independent  with  the  same  marginal  probabilities. 

The  purpose  of  the  above  discussion  was  not  to  find  the 
largest  exponents  achievable  for  the  collision  channel,  b'.n: 
rather  to  illustrate  why  error  exponents  are  far  more  complicated 
tor  multiaccess  channels  than  for  single  input  channels.  It  also 
illustrates  why  there  is  no  simple  sphere  packing  lower  bound  to 
for  multiaccess  cnannels  that  yields  thr  same  error  exponents 
as  the  random  coding  bound.  Arutyunyan  L15]  has  developed  a  type 
of  sphere  packing  bound  for  multiaccess  channels,  but  it  is 
somewhat  loose  since  it  does  not  account  for  the  separation  of 
the  two  encoders  for  the  type  3  errors. 


Ws  now  turn  to  another  example  or  somewhat  greater  practical 
importance  where  the  random  coding  exponents  work  out  more 
nicely.  Suppose  the  X,  W,  and  Y  alphabets  are  each  the  set  of 
real  numbers,  and  the  output  y  is  given  by 


where  z  is  a  zero  mean  Gaussian  random  variable  of  variance 
independent  of  x  and  w.  The  x  input  and  w  input  are  each 
constrained  to  have  mean  square  values  at  most  and 
respectively.  If  we  consider  the  channel  as  a  cascade  of  a 
noiseless  channel  adding  x  and  w  followed  by  a  single  input 
Gaussian  channel,  we  see  that  I(XW:y)  is  at  most  the  capacity  of 
the  single  input  channel  with  the  input  constrained  to  energy 
Gj+S2.  Thus 


l‘XW;Y)  < 


1  og  I 


S,  +  S 


1 


( 2. 27} 


1"  is  also  easv  to  see  that  Il/<;r'|W;  is  the  average  mutual 
intonnation  between  x  and  v  in  the  absence  of  w.  fhus 


I  (  X ;  r  I W  ^ 


I  IW:  Y |X) 


1  og 


1  og  1 


(2.28) 


(2.29) 


These  inequalities  are  satisfied  for  all  independent 


distributions  on  j<  and  w  and  are  all  satisfied  with  equality  if  > 


and  w  are  independent  zero  mean  Gaussian  with  variances  and  S- 


respecti vel y.  Thus  the  rate  region  for  which  (2.3)-(2.5>  are 


satisfied  for  some  independent  :<  and  w  distribution  is 


S,+3., 


1  r  =  ■ 

■^l-^  ^2  -  2  - 2 


<2. 30 j 


<  <  |-  lag[l  + 


(2.31) 


0  <  R 


2  - 


(2.32^ 


Since  this  region  is  convex  already,  it  is  the  achievable  rate 


reaion  R. 


This  region  R  is  sketched  in  fig„  2.5  for  various  values  of 


signal  to  noise  ratios  A  —  S/a*",  S  =  Sj^+S-^,  for  the  case  where 


“  ^2'  that  the  region  is  almost  rectangular  for  small  A 


and  almost  triangular  for  large  A.  Note  that  if  one  uses  TDM 


between  a  code  for  x  and  a  code  for  w,  then  the  achievable  rates 


are  limited  to  the  region  bounded  bv  the  straioht  line  between 


the  axis  intercepts  of  the  boundary  of  R  (see  fig.  2.6).  Thus 


for  large  A,  1  DM  is  almost  as  good  as  the  best  coding,  whereas 


for  small  A,  TDM  is  quite  inferior.  The  reason  for  this  can  be 


seen  most  clearly  for  the  case  =  R.^  =  R,  Alternating  between 
(R.O)  and  (u,R)  then  wastes  half  the  available  power,  since  (by 


our  model),  the  first  transmitter  stays  within  its  power 


limitation  v^hile  transmitting.  Losing  half  the  available  power 


loses  only  a  small  fraction  of  the  available  capacity  tor  large  A 
whereas,  for  small  A,  a  large  fraction  is  lost.  This  suggests 
going  to  a  continuous  time  model  rather  than  the  discrete  time 
model  here  and  using  frequency  division  multiplexing,  thus 
achieving  the  same  simplicitv  as  TDM,  but  being  able  to  use  all 
the  available  power.  Figure  2.6  shows  the  resulting  rate  reoion, 
assuming  the  same  power  for  each  transmitter  and  the  optimal 

split  of  frequency  between  the  transmitters  as  a  function  of  the 
rates . 

Next  consider  the  random  coding  exponent  for  these  channels. 
Using  the  above  Gaussian  distribution  for  x  and  w,  we  can  easily 
calculate  from  (2. 1  7)  -  (2. 1 9)  ,  replacing  sums  with 

integrals.  The  result  is 


rri — ] 

c  1 1  +  p  > 


where  Sj  =  +  ^2*  Letting  =  S^/cr'^,  we  can  maximize 

*‘*^oi  '  ~f*^i  ^  over  p  to  get  the  parametric  equations 


P  A. 

(R.  ^  - 

2(l  +  p.)<i  +  p.  +A .  ) 

1  11 


i.  =  hr  ln[l  +  -j-i - - 

1  .t  L  i  +  pj  J 


OSp 

1 


2  I  l  +  p  )  ( 1  +  p . +A.  ) 
1  ^1  1 


(2.34) 


For  rates  lower  than  those  where  pj  =  1 , 


for  <  -  In^l  -H  —  J  -  ^ 


+rt.  ) 
1 


(2.35) 


As  in  (2.22)  and  (2.23),  the  random  coding  exponent  E|^(Rj,R-^)  is 
the  minimum  of  E|^^(R^)  over  i  =  1,2,3.  The  region  R  divides  into 
three  subregions  as  shown  in  fig.  2.7  where  E^^ (R^ )  for  each  i  is 
dominant.  As  the  rates  decrease,  the  error  probability  of  type  3 
errors  decreases  more  rapidly  than  that  for  type  1  and  2  errors, 
so  that  for  small  rates  the  bound  is  dominated  by  errors  in 
source  1  or  2  but  not  both. 

For  a  single  input  additive  Gaussian  noise  channel,  choosing 
a  coding  ensemble  with  the  Gaussian  distribution  is  not  quite  the 
best  thing  to  do  for  error  exponents.  The  best  distribution 
results  from  a  shell  constraint.;  that  is,  code  words  are  chosen 
with  a  Gaussian  distribution  conditional  on  the  resulting  word 
having  an  energy  very  close  to  NS ^ .  This  distribution  (see 
section  7.4,  CIOJ)  yields  the  same  exponent  to  Pg  as  the  sphere 
packing  bound  for  rates  sufficiently  close  to  capacity. 

For  a  multiaccess  channel,  it  seems  reasonable  to  again 
consider  a  random  coding  ensemble  using  a  shell  constraint  on 
each  set  of  code  words.  From  the  genie  interpretation  of  type  1 
and  2  errors,  we  see  that  is  upperbounded  by  the  probability 

of  error  for  the  first  set  of  code  words  with  the  additive 
Gaussian  noise  but  without  the  second  set  of  code  words.  Thus, 
for  i=l,2,  we  have  Pg^  <  a^N  expC-NE-^  (R; ) 3 ,  where  from  section 
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P  .  >  eKp  -NCE  (R.)  +a(N)3l  ;i=l,2 

ei  ri  1  J 

for  all  cades,  where  a(N)  approaches  0  with  increasing  N. 

Far  type  3  errors,  the  situation  is  less  simple  since  the 
combined  code  words  x  +  w  are  not  constrained.  In  fact,  if, 
after  constraining  x  to  have  energy  NSj  and  w  to  have  energy  NS2? 
we  then  constrained  x+w  to  have  energy  N(Sj^+S2),  we  would  then  be 
constraining  the  code  words  of  the  two  codes  to  be  orthogonal, 
which  corresponds  (on  a  continuous  time  channel)  to  the  frequency 
division  multiplexing  discussed  previously. 

We  now  develop  a  bound  on  using  a  shell  constraint  on 

the  code  words  x.^  and  Wq.  Choose  each  x  independently  using  the 
densitv  (X)  and  each  w  using  the  density  Q-.^w)  where 


Q  (n) 

1 


<2.42) 


y  7 

1;  for  NS.  -  6  <  )  5  NS, 


i .  <x ) 

1 


n==l 


n 


0:  otherwise, 


(2.43) 


where  6  is  an  arbitrary  positive  number .  and  is  a  normalizing 
constant  to  make  Qj^(x)  integrate  to  1.  Substituting  (2.42)  for 
Qj^(x)  and  Q-7(w)  into  (2.8).  replacing  sums  with  integrals,  and 
upper  bounding  -j>^(x)  by 


>  0 


(2. 44) 


<x)  <  e;;pCr.6  +  )  r,(:<'^-S.)]  ;  r. 

1  1  4,  ini  i 

n=l 

W0  -find  that  <2. 8)  breaks  into  a  product  -form  (as  in  section  7. 
of  CIO]).  A-fter  some  tedious  integration,  we  get,  for  any  f,  0 
f'  ^ 


P  ^ 
eo- 


I  MjM2  ' 


s;<  p  C  -N  ( E  »;  p  ,  r  )  -  pR„ )  ] 
O'J  ■:;> 
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Ej..j^_(p,r)  =  U  +  p)  In 
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1  +  P 
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( *")  +  ||-  1  n  1 


0  =  ( 1  +  p)  ( l-2r . S .  ) 

1  ^  11 


(2 


4 


The  first  term  in  (2.45)  is  proportional  to  for  any 

given  choice  of  rj^,r2,  and  6,  so  we  simply  bound  it  by  aN'^  for 
some  suitable  a.  The  exponent  can  be  optimised  over  p,  r^,  r.^^ 
(or  equivalently  over  p,  for  0  <  p  £  1  ,  0  £  £  1-t-p). 

For  the  important  case  where  Aj  =  A-.-  the  optimization  can  be 
carried  out  explicitly.  Here  by  symmetry,  the  optimal  and  0 
are  equal,  and  such  a  solution  is  also  valid,  but  not  optimal, 
for  all  A,  and  A.;).  Using  6  for  Q.  and  and  A  for  A,  +  A-^i, 


=  iLln  — “  o  -  Ij  +— ln(l  + 


t2.54) 


«  =  1  -  ^  ^  ln(A'^+2A+4>  <2.55) 

This  exponent  lies  roughly  half  way  between  the  previously 
derived  exponent  without  a  shell  constraint  and  the  exponent  with 
a  shell  constraint  that  would  result  tor  a  single  input  Gaussian 
channel  with  signal  to  noise  ratio  A  <i.e.  that  given  by  (2.36)- 
(2. 4i> . 

When  we  take  the  minimum  of  the  three  exponents  E^^<R^)  for 
i  =  1.2,3,  we  again  find  that  the  achievable  region  R  breaks  into 
3  subregions,  one  where  each  bound  is  dominant;  the  regions  look 
the  same  as  in  fig  2.7,  although  numer i cal  1  v'  they  are  somewhat 
different.  We  now  know,  however,  that  whenever  the  rate  pair 

.R-J  is  in  R,  (or  and  Fv'j^  (or  R:  ?)  is  above  the  critical  rate 

(2.0'6/  ,  then  E|^(R'j^,R2)  is  indeed  the  exponent  for  optimal 
codes.  For  tne  symmetric  case  where  -  Rv,,  the  region  R-r 
vanishes  for  small  enough  Rj  =  R;,>,  and  if  the  point  where  Rt 
vanishes  is  above  the  critical  rate  for  and  R-, ,  then  the 
optimum  exponent  is  given  bv  (2. 37) - (2. 39;  between  the  point 
where  R-j  vanishes  and  the  critical  rate.  This  phenomenon  occurs 
whenever  the  combined  signal  to  noise  ratio  At  is  belnw  about  3. 


be  used  in  the  total  absence  of  relative  timing  between  the 
transrni  tters. 

Having  cautioned  the  reader  about  the  modeling  problems 
inherent  in  a  discrete  time  memory less  model  ot  multiaccess 
channels,  we  now  return  to  this  model  to  see  --^hat  can  be  said 
about  coding. 

First,  there  is  a  fairly  simple  general  approach  that 
can  reduce  the  decoding  problem  to  several  single  source  decoding 
problems.  First  suppose  that  (R.^,R2)  satisfies  <  KXjVjW),  R-- 
IcW.k')  for  some  assignment  Q2(w).  Over  the  ensemble  or 

codes  using  Qj,G!2,  a  decoder  can  decode  the  w  code  word  by 
ignoring  the  k  code  word  and  assuming  a  single  input  channel  with 
transition  probabi  1  i  ti  es  F(vjw;  =  Z...  u? )  P  (y  |  x  w>  .  Over  the 
ensemble  of  codes  for  the  first  encoder,  this  is  precisely  the 
set  of  transition  probabilities  from  w  to  y.  Thus  a  "good" 
decoder  for  a  single  input  channel  can  decode  w  reliably.  Given 
w,  another  decoder  for  a  single  input  channel  can  decode  M  usino 
^'■'n  l’'n'^n' •  This  second  decoding  is  somewhat  unconventional  for 
=ingle  inputs  in  that  the  transition  probabilities  depend  on  w^ 
and  thus  vary  with  n.  but  a  number  of  decoding  techniques  such  as 
sequential  decoding  and  Viterbi  decoding  can  deal  with  this 
si tuati on . 

As  can  be  seen  from  fig.  3.1,  any  in  the 

interior  of  the  achievable  region  of  <2.3)-(2.5)  for  a  given 
G!j^,Q2  can  be  represented  as  a  convex  combination  of  two  rate 
pairs,  one  of  which,  (R|,R2),  satisfies 


— ‘T  cr  — 


R'  KX;  Y  jW);  R'  I(W;Y)  <3.1) 

and  the  other  of  which  satisfies 

R"  <  KXjV):  R;!!,  <  KWiYlX)  (3.2) 

X  Jam 

Codes  for  each  of  these  rate  pairs  can  be  decoded  by 
the  two  step  procedure  described  above  and  (Rj^.R.-^)  can  be  decoded 
bv  time  sharing  between  two  such  codes. 

Finally,  anv  point  in  the  interior  of  the  achievable 
rate  region  is  a  convex  combination  of  two  rate  pairs,  one  of 
which  satisfies  (2. 3)- (2.5)  with  strict  inequality  for  some  Q]^Q2 
and  the  other  for-  some  other  Thus  an  arbitrary  point  in 

the  interior  of  R  can  be  reliably  decoded  by  time  sharing  between 
at  most  4  codes,  two  of  which  use  rates  satisfying  (3.1),  (3.2) 

respectively  for  Qj^Q2  and  the  other  two  of  which  satisfy  (3.1), 
(3.2)  for  CiifQ*. 

This  approach  is  not  entirely  satisfactory  for  two 
reasons.  The  first  is  that  the  random  coding  exponents  for  error 
probability  in  this  approach  are  often  much  smaller  than  those 
for  joint  decoding  of  the  two  code  words  together.  If  we  use 
error  exponents  as  a  crude  measure  of  decoding  simplicity,  we  see 
that  joint  decoding  is  potentially  simpler  than  the  above  single 


input  decoding 


Note,  however,  that  error  exponents  can 


sometimes  be  misleading  as  a  guide  to  decoding  complexity.  For 
example,  the  random  coding  exponent  for  a  noiseless  binary 
channel  is  not  large,  whereas  coding  and  decoding  are  trivial. 

The  other  objection  to  this  approach  is  that  it  fails 
to  provide  much  insight  into  the  question  of  joint  decoding  of 
several  sources.  It  certainly  does  not  generalize  to  the  use  of 
a  small  but  unknown  subset  of  a  large  set  of  transmitters. 

A  second,  simpler  but  less  general,  approach  is  to 
decode  the  code  words  from  each  transmitter  independently 
regarding  the  other  as  noise.  From  fig.  2.5,  it  is  seen  that  for 
the  hWGN  channel  with  small  signal  to  noise  ratio,  the  achievable 
rate  region  is  almost  rectangular.  Analytically  HXjsY)  = 
<l/2)lnCl  +  Aj/(1+A2)]  which  is  close  to  IU;Y|W)  =  ( 1 /2)  1  nC  l+A^  3 
when  A2  is  small.  In  this  case,  the  error  exponent  for 
individual  decoding  is  almost  the  same  as  for  joint  decoding. 

This  approach  has  the  advantage  of  generalizing  immediately  to 
the  case  of  a  large  number  of  sources  with  an  unknown  subset  of 
the  sources  transriu, tti ng .  Spread  spectrum  with  pn  sequences  can 
be  viewed  as  a  special  case  of  this  approach  where  the  use  of  a 
pn  sequence  or  its  complement  over  a  given  period  is  simplv  an 
added  constraint  on  the  encoding.  Multiaccess  pulse  position 
n\odulation  l"2i3,  C223,  C56]  can  be  viewed  the  same  wav. 

For  an  arbitrary  discrete  time  memoryless  multiaccess 
channel,  perhaps  with  more  than  two  transmitters,  one  can 
similarly  investigate  ways  to  choose  code  word  sets  for  the 
individual  transmitters  in  such  a  wav  that  they  are  mutually  non 


interfering  (more  precisely,  so  that  they  can  be  individually 
decoded  with  small  error  probability).  Time  sharing  within  a 
code  word  is  one  possibility,  but  depending  on  the  channel ,  other 
possibilities  might  be  preferable,  as  we  have  seen  for  the  AWQN* 
channel.  A  more  difficult  related  problem  is  to  choose  the  code 
word  sets  in  such  a  way  as  to  maintain  the  non-interference 
property  in  the  presence  of  lack  of  symbol  synchronism  between 
the  transmitters.  We  have  seen  that  this  can  be  done  for  the 
hWGN  channel,  and  Massey's  coding  scheme  C143  for  the 
asvnchronous  collision  channel  also  achieves  this  objective;  at 
present,  however,  no  approaches  are  known  for  general  discrete 
time  memory less  channels. 

As  a  third  approach  to  decoding,  consider  true  joint 
decoding  of  the  two  code  words.  I  will  not  consider  algebraic 
decoding  techniques  here  since  an  algebraic  structure  musi:  be 
matched  in  some  sense  to  the  channel  characteristics  and  I  am  not 
aware  of  any  examples  of  algebraic  approaches  for  general 
multiaccess  channels.  Viterbi  decoding  of  convolutional  codes  is 
avnother  possibility,  but  it  does  not  appear  very  promising  as  a 
joint  decoding  technique.  The  problem  is  that  the  decoder  should 
trad:;  a.il  possible  states  of  both  encoders,  which  leads  to  a 
combined  nutnber  of  states  which  is  the  product  of  the  individual 
numbers  of  states.  With  more  than  two  transmitters,  the  problem 
IS  even  worse. 

Finally,  sequential  decoding  appears  to  be  a  general 
approach  to  multiaccess  joint  decoding  and  it  has  been  shown  C23] 
that  lack  of  block  synchronisation  is  not  a  serious  impediment  to 


1  -5  operation-  Unfortunately,  at  this  time,  it  is  not  clear  how 
to  make  sequential  decoding  work  for  a  multiaccess  channel.  To 
explain  the  dif-ficulty,  recall  that  sequential  decoding  is  a 
search  procedure  that  hypothesizes  the^  encoded  sequence  up  to  a 
given  point  and  either  proceeds  forward  by  extending  the  encoded 
sequence  or  searches  backward  depending  on  the  value  of  a 
metf ic"  thac  stochastically  drifts  upward  when  the  decoder  is 
following  tlie  actual  encoded  sequence  and  drifts  downward  when 
the  decoder  yets  off  the  track. 

The  problem,  now,  is  that  the  decoder  can  go  off  the 
track  in  three  ways,  corresponding  to  the  three  types  of  errors 
in  section  2.  Unfortunately  the  appropriate  metric  to  use 
depends  on  the  type  of  error  being  made,  and  this  knowledge  is 
unknown  to  the  decoder. 

Another  fundamental  problem  with  sequential  decoding 
has  recently  been  discovered  by  Arikan  C24].  Arikan  considers  a 
multiaccess  binary  erasure  channel  where  X  =•  fO.l},  W  =  fO,!;-  and 
T  =  -LiUtOj,  vO,i;,  <l,u,’,  (e,e)}.  With  prooabi  1  i  ty  l~e, 

for  some  e  >  o,  v  =  (k.w; ,  whereas  with  probability  s, 
independent  of  the  input,  y  =  (e,e).  In  effect  we  have  two 
erasure  channels  with  perfectly  correlated  erasures.  Using 
equiprobable  inputs  for  each  transmitter,  we  can  formally 
calculate  the  computational  cutoff  recjion  R 

comp 


for  a  joint 


we  note  that 


-2  1  n  j  >  -  In  j  5  all  £,  0  <  e  <  1 

( •  o ) 

Thus  for  =  R2.  <-3.5)  is  the  active  constraint,  and  even 

without  any  of  the  metric  problems  discussed  above,  (3.5)  limits 
the  achievable  rate  with  joint  sequential  decoding.  However, 
using  separate  sequential  decoders  for  the  two  transmitters  and 
ignoring  the  er assure  correlation,  we  can  achieve  the  higher  rates 
of  (3.3)  and  (3.4). 

To  make  the  situation  worse,  we  see  that  -  lnC(l+3s;/43  is 
also  the  computational  cut  off  rate  of  a  single  input  quaternary 
erasure  channel.  However,  by  regarding  the  inputs  to  the 
quaternary  channel  as  two  binary  digits  and  using  separate 
convolutional  encoders  and  decoders  for  the  two  digits,  we  can 
again  achieve  the  higher  rates.  The  dirficulty  here  doss  not 
reside  in  the  particular  search  algorithm  being  used.  Gver  the 
ensemble  of  convolutional  codes  for  the  quaternary  input  (or 
pairs  of  codes  for  binary  inputs),  the  expected  number  of 
potential  encoded  sequences  (or  pairs  of  sequences)  at  length  W 
which  are  as  likely  as  the  transmitted  sequence  (or  pair)  is 


exponentially  increasing  in  N  for  any  combined  rate  in  excess  of 
-InC  ( 1  i-3e) /41 .  The  conclusion  that  one  must  reach  is  that  R 

comp 

is  not  really  a  tundamental  parameter  ot  communication.  This 
same  example,  in  the  context  o-f  the  phonon  channel,  has  been 
discussed  by  Massey  L253  and  Humblet  C263. 


Summarizing  the  previous  approaches  to  decoding,  we  see 
that  much  more  research  is  necessary  before  any  cohesive  body  of 
knowledge  about  coding  and  decodina  for  multiaccess  channel=;  will 


the  simplest  context  but  also  severely  limits  the  class  or 
strategies  and  tradeofts  that  can  be  considered. 

Infinite  Set  or  Transmitters:  Assume  that  each  arriving 
packet  arrives  at  a  transmitter  that  has  never  previously 
received  a  packet.  This  precludes  queueing  at  individual 
transmitters  and  precludes  the  use  of  TDH.  This  is  an 
unreasonable  assumption  from  a  practical  point  of  view,  but  note 
that,  given  any  algorithm  determining  when  the  transmitters  send 
packets,  a  finite  set  of  transmitters  can  use  the  same  algorithm, 
regarding  each  packet  arrival  as  corresponding  to  a  separate 
conceptual  transmitter.  In  this  case,  a  physical  transmitter 
would  sometimes  send  simultaneous,  colliding  multiole  packets. 
This  shows,  first,  that  assumption  c)  provides  a  worst  case  bound 
on  a  finite  set  of  transmitters  ana,  second,  that  the  difference 
is  onlv  significant  when  two  or  more  packets  are  waiting  at  the 
same  transmitter.  Collision  resolution  algorithms  are  primarily 
useful  for  low  inout  rates  where  multiple  packets  rarely  queue  up 
at  one  transmitter:  in  this  region,  the  performance  with  a  finite 
set  of  transmitters  should  be  well  approximated  by  that  with  an 
infinite  set.  The  maximum  throughput  of  an  algorithm  under  the 
infinite  set  assumption  is  a  qualitative  measure  of  the  goodness 
of  the  algorithm,  avoiding  the  less  fundamental  throughput 
improvements  achievable  when  queueing  occurs  at  each  transmitter. 

Poisson  Arrivals:  Assume  that  new  packet  arrivals  are 
P*^isson  at  an  overall  rate  X.  This  is  reasonable  given 
independent  arrival  proceses  at  the  individual  nodes. 

b.  1,  c  Immediate  Feedback:  Assume  that  by  the  end  of  each 


1  packet,  or 


slat,  each  transmitter  learns  whether  0  packets, 
more  than  one  packet  (c  -for  collision)  were  transmitted  in  that 
slot.  This  is  the  only  information  that  each  transmitter  gets 
about  the  existence  of  packets  elsewhere.  The  assumption  of 
immediate  feedback  is  often  unrealistic,  but  collision  resolution 
algorithms  can  usually  be  modified  to  deal  with  delayed  feedback; 
the  introduction  of  delay  in  the  feedback,  however,  complicates 
analysis  with  little  benefit  in  insight.  The  assumption  of  0,  1, 
c  feedback  implies  that  the  receiver  <or  the  transmitters 
themselves)  can  distinguish  between  an  idle  slot  and  a  collision, 
which  is  not  always  reasonable.  It  also  implies  that  idle 
transmitters  are  always  listening  for  this  feedback,  which  is  not 
always  desirable.  Some  alternative  forms  of  feedback  will  be 
discussed  in  what  follows. 

4.1  SLOTTED  ALOHh 

The  simplest  form  of  collision  resolution  strategv  using 
tile  assumptions  above  is  Slotted  Aloha  ^Roberts  II27’i/.  Slotted 
Aloha  is  a  variation  of  pure  Aloha  (.Abramson  C13;,  which  will  be 
descr'ibed  subsequently.  In  slotted  Aloha,  whenever  a  packet 
arrives  at  one  of  the  transmitters,  that  packet  is  transmitted  in 
the  next  slot.  Whenever  a  collision  occurs  in  a  slot,  each 
packet  involved  in  the  collision  is  said  to  be  backlogged  and 
remains  backlogged  until  it  is  successfully  transmitted.  Each 
such  backlogged  packet  is  transmitted  in  each  subsequent  slot 
with  some  fixed  probability  p  >  0,  independent  of  past  slots  and 
of  other  packets.  Note  that  if  p  were  1,  backlogged  packets 
would  continue  colliding  and  no  more  packets  would  ever  be 


successfully  transmitted!  Note  also  that  because  of  the 
effectiveiv  infinite  set  of  transmitters,  the  collision  cannot  be 
resolved  by  transmitters  waiting  some  number  of  slots  determined 
by  the  identity  of  the  transmitter.  Such  strateoies  can  be  used 
with  a  known  set  of  transmitters  and  can  be  made  to  behave  like 
TDf'IA  under  heavy  loading. 

It  can  be  seen  that  slotted  Aloha  can  be  analyzed  as  a 
homogeneous  Markov  chain,  using  the  number  of  backlogoed  packets 
at  each  integer  time  t  as  the  state.  The  state  at  time  t 
includes  packets  that  collided  in  the  slot  from  t-1  to  t  but  does 
not  include  new  packet  arrivals  from  t-1  to  t.  Let  k  be  the 
state  at  time  t  and  k+i  be  the  state  at  t+1.  Thus  i  is  the 
number  of  new  packet  arrivals  in  Ct-l,t)  less  the  number  of 
successful  transmissions  \if  any)  in  ft. t  +  1;.  it  follows  thar.  i 

—  — i  if  no  new  packet  arrives  in  it-l,r;  and  one  backlogged 
packet  IS  transmitted  in  Ctjt+l).  Similarly  i  =  o  if  either  no 
new  packet  arrives  and  no  successful  transmission  occurs  or  one 
new  packet  arrives  and  is  successfully  transmitted. 

Analyzing  the  cases  i  >  O  in  the  same  way,  we  see  that  the 
state  transition  probabilities  are  given  by 
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In  understanding  how  this  chain  behaves,  we  look  first  at  the 
drift,  Dj, ,  defined  as  the  expected  value  of  i  conditional  on  k 
(i.e.  the  expected  difference  between  the  state  at  t+1  and  that 
at  t  conditional  on  the  state  at  t). 
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(4.2 


The  first  term  x  is  the  arrival  rate  and  the  second  term  is  the 
departure  rate  or  throughput.  Note  that  for  any  X  >  0  and  any 
p  >  0.  D^,  will  be  positive  for  all  sufficiently  large  k .  This 
means  that  if  the  system  becomes  sufficiently  backlogged,  it 
drifts  in  the  direction  of  becoming  more  and  more  backlogged; 
this  should  not  be  surprising  since  collisions  occur  on  almost 
ail  slots  when  the  backlog  gets  sufficiently  large.  Kaplan  C23] 
gives  a  simple  but  elegant  proof  that  this  type  of  chain  is 
unstable  (i.e.  non-ergod i c ) . 

Despite  the  instability  of  slotted  Aloha,  it  can  still  be  a 
useful  collision  resolution  approach  especially  if  the  system  is 
modified  to  avoid  or  recover  from  the  heavily  backlogged  State. 
Using  a  small  value  of  p  helps  postpone  the  onset  of  the 
catastrophic  behavior  above,  and  for  small  p,  (4.2)  can  be  well 
approximated  bv 


'•  ~  (X+pk)e 


- ( X+p  k ) 


(4.3 


Fig.  4.1  illustrates  this  equation.  For  X  >  e~^,  we  see  that  Dj^. 

-1 


>  0  for  all  k. 


For  X  e 


,  there  is  a  range  of  k  for  which 


D^,  •••:.  (.) ,  and  the  size  of  this  range  increases  as  X  decreases  and 
as  p  decreases.  Unfortunately,  X  is  the  arrival  rate  which  we 
would  rather  not  decrease,  and  small  p  nrieans  laroe  delav  between 
retrials  of  a  collided  packet. 

This  tradeoff  in  p  is  very  undesirable;  large  p  makes  it 
very  easy  to  enter  the  unstable  heavily  backlogqed  reoion, 
whereas  small  p  causes  large  delay  for  collided  packets  in  the 
stable  region.  The  engineering  solution  is  almost  obvious — 
change  p  as  the  backlog  k  changes.  Ideally,  we  would  1  i  h.o  to 
adjust  p  to  minimize  Dj, ,  which  occurs  at  pk  +  X(l-p)  =  1.  For 
large  k ,  this  maintains  a  throughput  of  e“’.  For  small  k,  on  the 
other  hand,  p  is  large  and  thus  delay  is  small.  The  problem  with 

this  solution  is  that  k  is  unknown,  and  either  k  must  be 

estimated  from  the  feedback  or  an  appropriate  value  of  p  must  be 
estimated.  Hajek  and  VanLoon  C29II  have  analyzed  a  class  of 
algorithms  in  which  p  is  updated  at  each  slot  simplv  as  a 
function  of  the  previous  p  and  the  feedback  i nf crmat i on .  They 

showed  that  such  functions  cam  be  cnosen  for  any  X  ■(  e  so  as  to 

make  the  resulting  svstem  scable. 

From  (4.3).  we  see  that  D^,  is  positive  whenever  X  >  1/e, 

This  13  only  an  appro:;  i  mat  i  on  of  (4.2),  but  the  appro;;  i  mat  i  on  is 
good  when  p  is  small,  and  p  must  be  small  when  k  is  laroe  to 
minimize  Dj,.  Thus,  for  X  >  1/e,  Dj^,  is  positive  for  all 
sufficiently  large  k  no  matter  how  p  is  chosen,  so  that  slotted 
rtioha  is  unstable  in  this  case  even  if  k  is  known. 


In  the  ne:ct  subsection  we  show  that  much  higher  throughputs, 
and  presumably  smaller  delays,  are  possible  when  newly  arriving 


packets  are  sometimes  held  up  and  collisions  are  resolved  in  more 
sophisticated  ways.  Slotted  Aloha,  however,  has  the  advantage  of 
not  requiring  all  the  -feedback  information  we  have  assumed.  For 
many  physical  multiaccess  channels,  particularly  dispersive 
fading  channels,  it  is  difficult  to  distinguish  an  idle  slot  from 
a  collision  with  high  reliability.  It  is  usually 
straightforward,  through  use  of  a  cyclic  redundancy  check,  to 
distinguish  a  successful  transmission  from  idle  or  collision,  and 
it  can  be  seen  that  this  kind  of  feedback  is  sufficient  for 
slotted  Aloha  but  not  sufficient  for  the  more  soph i-sti cat ed 
strategies.  Unfortunately  it  is  much  more  difficult  to  estimate 
the  backlog  with  this  type  of  feedback.  Crus  C473,  however,  has 
shown  that  slotted  Aloha  can  be  stabilized  for  throughputs  less 
than  1/e  whenever  the  feedback  can  be  modelled  as  the  idle, 
success,  or  collision  information  passed  through  a  discrete 
mernorviess  channel  of  positive  capacity,  and  the  case  above  can 
be  modelled  in  this  way. 

Pure  Aloha  Cl]  was  the  precursor  of  slonted  Aloha  and  avoids 
our  assumption  of  a  slotted  svstem.  although  we  continue  to 
assume  that  each  packet  requires  one  time  unit  for  transmission, 
that  overlapping  packets  collide,  and  that  assumptions  r.  i  ,  d>, 
and  e'l  hold.  Each  newly  arrived  packet  is  transmitted 
immediately  upon  arrival  and  backloqqed  packets  are  transmitted 
after  an  exponent i al 1 y  distributed  delay.  The  probability  of 
collision  is  higher  here  than  in  a  slotted  system;  a  packet 
starting  transmission  at  time  t  will  collide  with  other  packets 
starting  anywhere  in  the  interval  (t-l,t-+l).  The  upper  bound  on 


throughput  becomes  <2e;  and  the  same  kinds  of  stability  issues 
arise  as  for  the  slotted  system.  A  major  practical  advantage  ot 
pure  Aloha,  however,  is  its  ability  to  handle  packets  ot 
dif-ferent  lengths  C30,31]. 

4.2  SPLITTING  ALGORITHMS 

In  our  discussion  ot  slotted  Aloha,  we  saw  that  the 
throughput  is  upper  bounded  by  1/e  regardless  of  the  strategy 
used  to  adjust  the  retransmission  probability  of  collided 
packets.  This  bound  was  imposed  by  the  restriction  that  new 
arrivals  were  always  transmitted  in  the  ne;;t  slot  after  their 
arrival  and  that  backlogged  packets  depended  upon  a  single 
parameter  p  for  retransmission.  To  get  an  intuitive  idea  of  why 
the  transmission  of  new  arrivals  should  sometimes  be  postponed, 
consider  a  slot  in  which  two  packets  collide.  If  the  new 
arrivals  were  held  up  until  the  collision  were  rgsol'-ed,  tnen  a 
reasonable  strategy  would  be  for  each  colliding  packer,  to 
retransmit  in  the  following  slot  with  pronataility  1/2.  With 
probability  1/2,  then,  a  successful  transmission  occurs  and  the 
other  packet  would  be  transmitted  in  the  fcllowino  slot. 

A.I.  ternati  vel  y ,  with  probability  1/2,  another  collision  or  an  idle 
sli3t  ensues,  wasting  one  slot.  Again,  in  this  case,  each  packet 
would  be  transmitted  in  the  following  slot  independently  with 
probability  I.-" 2,  and  so  forth  until  the  two  packets  are 
successfully  transmitted.  The  expected  number  of  slots  required 
to  successfully  transmit  the  two  packets  is  easily  seen  to  be 
which  yields  an  effective  throughput  of  2/3  during  the  collision 


This  concept  of  probatai 1 i sti cal  1 y  splitting  the  set  of 
packets  involved  in  a  collision  into  a  transmitting  set  and  a 
non-transmitting  set  while  making  other  packets  wait  is  the 
central  idea  of  a  variety  of  collision  resolution  algorithms  that 
achieve  throughputs  larger  than  1/e  while  using  assumptions  a)  to 
e) ;  we  call  these  algorithms  splitting  algorithms.  These 
algorithms  differ  in  the  rules  used  for  splitting  the  collision 
set  (which  might  involve  more  than  two  packets)  and  in  the  rules 
for  allowing  waiting  packets  not  involved  in  a  collision  to 
transmit  after  the  collision  is  resolved. 

The  first  splitting  algorithms  were  the  tree  algorithms 
developed  by  Capetanakis  C32j,  Hayes  C331.  and  Tsybakov  and 
Mikhailov  t341.  In  these  algorithms,  the  system  alternates 
between  two  modes — normal  mode  and  collision  resolution  modeu 
When  a  collision  occurs  in  normal  mode,  all  transmitters  go  into 
collision  resolution  mode,  all  new  arrivals  wait  until  the  nejtt 
transition  into  normal  mode,  and  all  packets  invi::lved  in  the 
collision  independently  select  one  of  two  subsets  with  e'::|ua.l 
probability.  We  view  each  subset  as  corresponding  to  a  dranch 
from  tlie  root  or  a  rooted  binary  tree  (see  fig.  4.2).  In  the 
slot  following  the  collision,  the  first  of  these  subsets  is 
transmitted.  If  another  collision  occurs,  this  subset  is 
further  split  into  two  smaller  subsets,  corresponding  to  further 
branches  growing  from  the  original  branch.  The  first  of  these 
subsets  is  transmitted  in  the  next  slot,  and  if  this  transmission 
IS  successful  or  idle,  the  second  of  the  subsets  is  transmitted 
in  the  following  slot.  In  general,  whenever  the  transmission  of 


a  subset  results  in  a  collision,  the  subset  is  split  and  two  new 
branches  of  the  tree  are  grown  from  the  old  branch.  Whenever  the 
transmission  of  a  subset  is  idle  or  successful  (i.e.  the  subset 
is  empty  or  contains  one  packet),  the  next  slot  is  used  to 
transmit  the  next  subset.  When  all  subsets  have  been  exhausted, 
the  normal  mode  is  again  entered. 

It  should  be  apparent  that  if  this  algorithm  spends  many 
slots  resolving  a  collision,  then  typically  many  new  arrivals 
will  eagerly  be  awaiting  the  return  to  normal  mode  and  a 
resounding  collision  will  ensue.  What  is  even  worse  is  that  many 
successive  collisions  will  fallow  until  the  expected  number  of 
packets  in  a  subset  becomes  on  the  order  of  1.  Thus  the 
algorithm  can  be  improved  by  eliminating  the  normal  mode;  at  the 
end  of  a  collision  resolution  period,  a  new  collision  resolution 
period  is  immediately  entered  and  each  waiting  packet  randomly 
joins  one  of  k  subsets.  The  number  k  increases  with  the  lenqth 
of  the  preceding  collision  resolution  period  so  that  the  expected 
number  of  packets  pvsr  subset  is  on  the  order  of  one.  The 
corresponding  tree  has  k  branches  rising  from  the  root  and  two 
branches  rising  from  each  non-leaf  node. 

Capetanakis  C321  showed  that  this  algorithm  has  a  maximum 
throughput  of  0.43  and  is  stable  for  all  input  rates  less  than 
0.43.  The  maximum  throughput  attainable  with  tree  algorithms  was 
later  increased  to  0.46  due  to  a  simple  improvement  first 
suggested  by  Massey  C353.  Note  what  the  algorithm  does  when  the 
set  involved  in  a  collision  is  split  into  two  subsets  of  which 
the  first  is  empty.  The  first  slot  following  the  collision  is 
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transmitted  in  a  slot  and  a  cal li si  on  results,  then  the  interval 
15  split  into  two  equal  subintervals  and  the  packets  in  the  first 
subinterval  are  regarded  as  the  first  subset  and  those  in  the 
second  as  the  second  subset.  With  this  approach,  packets  are 
always  sent  in  a  first  come  first  served  (FCFS)  order,  so  we  call 
this  a  FCFS  splitting  algorithm. 

We  now  e;;press  the  algorithm  precisely.  Suppose  that  at 
integer  time  t  the  algorithm  has  successfully  transmitted  all 
packets  that  arrived  before  some  time  Tit)  (not  necessarily 
integer).  In  the  slot  Ct,t-i-l),  all  the  packets  that  arrived 
between  T(t)  and  T(t)+n<t)  are  transmitted.  The  time  Ti.t)  and 
the  interval  size  n(t)  are  determined  by  each  transmitter  based 
an  the  history  of  the  feeoback  up  to  time  t.  It  is  helpful  to 
view  the  packet  arrivals  in  CT(t).t)  as  being  in  a  distributed 
queue  (see  fig.  4.3).  We  would  like  to  allocate  the  queued 
packets  one  at  a  time  starting  at  the  front  of  the  queue,  but  the 
individual  arrival  time  of  each  paciuat  is  unknown  except  to  the 
transmitter  for  that  packet.  Thus  the  algorithm  attempts  to 
allocate  an  interval  |.((t)  at  the  front  of  the  queue  so  as  to 
transmit  the  waiting  packets  as  quickly  as  possible.  Note  that 
ma:;  i  mi  c  1  no  the  probability  of  success  in  the  next  slot  is  not  the 
best  thing  to  do  since,  as  we  have  seen,  a  collision  in  the  ne:;t 
slot  allows  a  higher  throughput  in  the  succeeding  few  slots  than 
13  possible  with  an  idle  slot  or  successful  slot. 

The  algorithm  given  below  determines  pCt),  T(t),  and 
Q(t)ECl,2}  for  the  slot  Ct,t+1)  in  terms  of  n(t-l),  T(t-l),  Q(t- 
1).  and  the  feedback  (0,1, c)  for  the  slot  Ct-l,t).  The  state 


Q(t)  reprssents  the  number  of  subsets  currently  under 


consideration.  Q(t)  is  set  to  2  if  one  of  the  intervals  for  slot 
Ct-l,t)  has  been  divided  into  2  for  slot  Ct.t+l)  and  is  set  to  1 
otherwise.  The  algorithm  also  has  a  parameter  Pc,  that  determines 
the  size  of  allocation  interval  to  be  used  after  a  collision 
resolution  period  is  completed.  It  turns  out  that  to  achieve 
maximum  stable  throughput,  p,-)  =  2.6.  Note  that  the  allocation 
interval  is  also  limited  by  t-T(t) .  the  interval  of  arrival  times 
that  are  still  waiting  for  transmission. 

F CF3  £p 1 i tt i no  A1 oor i thm; 

if  feedback  =  c  then 

T<t)  =  Kt-l);  Q(t)  =  2; 

uUt)  =  u(t-l)/2  1.4.4) 

if  feedback  =  0  or  1  ana  Q(t-l)  =  :i  then 
Ht)  =  T(t-l)+u^t-l;  :  Q<t;  =  1; 

p(t)  =  minC  u^,^,t-T  <t)  3  '!4.5) 

if  feedback  =  1  and  Q<t-l;'  =  2  then 
T(t)  =  T(:t--l)+n(t-l.' ;  Q\t;  =  1; 

M<t)  =  .u(t-l>  (.4.6) 

if  feedback  =  0  -and  Q<t-i)  =  .2  then 
T  ft)  =  r  '  .  t  - 1 )  f  p  ( t  - 1 )  :  Q  <  t  •>  =  2 ; 

i-i.  (.  t )  “  |j.  ( t  -  I )  /  2  4 , 7 ) 

In  case  of  a  collision  in  slot  ilt-l,t>.  Eq.  (4.4;  splits  the 
allocation  interval  lIT(t-l;,  T  (t--l ) +p(t -1 ;  into  two  equal 
subi nterval 3.  Q(t)  =2  allows  the  algorithm  to  "remember"  the 
existence  of  these  two  subintervals.  If  there  was  a  previous 
subinterval  CT ( t-1 ) +p (t-1 ) ,  T <t-l ) +2p(t-l ) ) ,  the  algorithm 
"forgets"  about  it  at  this  point,  regarding  that  subintarval  as 
part  of  the  waiting  queue.  As  pointed  out  before,  the  number  of 


packets  in  that  subinterval,  conditional  on  the  feedback  history 
is  Poisson  with  parameter  Xn(t“l). 

Eq..  (4. 5.'  corresponds  to  the  end  of  a  collision  resolution 
period  or  a  subsequent  period  with  no  collisions  and  simply  move; 
the  head  of  the  queue  and  allocates  a  new  interval.  Eq.  (4..6) 
corresponds  to  a  successful  transmission  of  the  first  subinterval 
from  a  previous  collision  and  movement  to  the  second  subinterval. 
Finally  (.4,/)  corresponds  to  Massey's  improvement  on  the  tree 
algarithm  when  a  collision  followed  bv  an  idle  (or  perhaps  seveal 
idlest  is  followed  by  splitting  the  second  subintervai. 

The  FCF5  splitting  algorithm  can  be  analysed  as  a 
homogeneous  Markov  chain,  using  Q(t),  p.(t)  and  t-T(t)  as  thi^ 

S'.ate  for  integer  values  of  t.  It  is  simpler,  however,  to 


segment  the  sequence  of  slots  into  collision  resolution  periods, 
where  a  new  collision  resolution  period  is  defined  to  start  each 
time  that  (4.5)  is  executed:  note  that  a  collision  rasolution 
period  could  be  a  sinole  idle  or  successful  slot  as  well  as  a 
collision  with  its  subsequent  resolution.  The  Markov  chain  for  a 
single  collision  resolution  period  depends  on  {.u't)  =  min  C  .  t- 
l't)J  for  t  at  the  beginning  of  the  period,  but  is  otherwise 
inoependent  of  t-T(t).  Consider  the  case  where  the  initial  u(t) 

-  M(j ,  since  tills  is  the  critical  case  corraspondi no  to  large 
backlogs.  At  each  update  in  the  period,  p  either  stays  the  same 
or  13  halved,  so  p  =  2“^  p,^  for  some  i  >  0.,  The  state  of  the 
chain  at  time  t  is  described  by  Q(t)  and  p(t),  so  we  denote  the 
state  at  time  t  by  where  j  =  Q(t)  and  i  is  such  that  p(t)  = 

4  ^Pq.  Figure  4.4  shows  the  possible  state  transitions 


as 


defined  by  (4.4)  to  (4.7).  From  S<n  <  ,  i  >  0,  an  idle  or 
collision  leads  to  S2,i  +  1  whereas  a  success  leads  to  From 

i  t  0,  an  idle  or  success  leads  to  whereas  a  collision 

leads  to  S7  i  +  i  ■ 

All  that  remains  to  complete  the  chain  is  to  calculate  the 
transition  probabilities.  In  state  we  have  two 

.iiL  •  1  ' 

subintervals  each  of  site  The  number  of  packets  in 

each  subinterval  is  a  Poisson  random  variable,  with  parameter 
,  conditional  on  the  sum  of  the  number  of  packets  in 
the  two  subintervals  beina  two  or  more.  The  transition  to  S, 
occurs  if  the  first  subinterval  contains  exactly  one  packet  (i.e. 
the  transmission  of  the  firsc  subinterval  is  successful).  The 
probability  of  this  is  then 

-Ap  -Ap, 

Au  e  1 1 -e  *1 

t  -  =  — - - ttt; -  :  i  >  1  (4.3) 

^  ■  1  u. 

1 

1  -  e  (l+ZAu  ) 

'  1 

In  staite  i  i  1,  we  are  abcur.  to  transmi c  che  second  of 

two  subintervais  each  of  size  ,  The  number  of  pacKets  in  each 
sub i nterval  is  roisson,  with  parameter  -APj  ,  conditional  both  on 
the  sum  being  two  or  more  and  the  first  interval  containing 
eKactly  one  packet.  Ti'tis  means  that  the  number  of  packets  in  the 
second  subinterval  is  Poisson  conditional  on  being  one  or  more. 
The  probability  of  a  transition  to  then  the  probability 

of  exactly  one  packet, 


so 


Finally  the  probability  of  a  direct  transition  from  to 

i  s 

-Xd,-, 

P .  =  ( 1  +  \  p .  )  e  ■  <  4 .  1 0 ) 

The  number  of  slots  in  a  collision  resolution  period  is 
simply  the  number  of  states  entered  before  the  first  return  to 
-l.O"  queue  length,  t-T(t),  has  an  increment,  over  a 

collision  resolution  period,  equal  to  the  number  of  slots  in  the 
period  less  the  change  in  T(t/;  the  change  in  T(t)  is  at  most  p,.-, 
but  is  reduced  bv  p.  if  a  collision  occurs  in  S-.  Letting  V  be 

.1  n  1 

the  increment  in  queue  length  over  a  collision  resolution  period, 
Ei'V)  can  be  evaluated  numerically  as  a,  function  of  A  and  Pj-, ,  and 
■ror  each  p,^.  there  is  a  maximum  A  for  which  V  <  0.  This  maximum 
A  is  maximized  over  p,-,  at  Pj-^  =  2.6,  and  the  resulting  maximum  X 
is  0.4871. 

Since  we  see  now  that  the  drift  in  the  queue  length  is 
negative  for  X  <  .4871,  it  is  plausible  that  the  algorithm  is 
stable  in  this  region.  To  make  this  more  precise,  define  a  busy 
period  of  the  algorithm  as  a.  consecutive  string  of  collision 
resolution  periods  starting  with  a  queue  length  t-T(t)  <  p^  and 
running  up  to  the  beginning  of  the  next  collision  resolution 
period  with  t-T(ti'  <  p,..  The  sequence  of  queue  lengths  at  the 


beginning  or  each  collision  resolution  period  torms  a  random  walk 
with  an  absorbing  barrier  at  the  end  o-f  the  busy  period.  The 
queue  length  increments  are  indeoendent  and  are  identically 
distributed  except  tor  the  first  increment,  where  the  initial 
H(t)  is  less  than  n,-,.  Observe  from  (4.9)  and  (4.10)  that 
-i'  1/2  and  1  as  i  This  means  that  the  random  variable 

V  (the  queue  length  increment  over  a.  collision  resolution  period) 
has  an  exponentially  decaying  distribution  function  and  thus  has 
a  moment  generating  function.  From  Wald  s  identity,  it  then 
fallows  that  the  number  N  of  collision  resolution  periods  in  a 
bu.sv  period  has  an  exponentially  decaying  distribution  function 
for  X  <  .4871.  It  is  also  easy  to  see  that  the  number  of  slots 
in  a  busy  period  is  at  most  Wq,", ,  and  therefore  the  number  of 
slots  in  a.  busy  period  also  has  an  exponentially  decaying 
oistribution  function.  Finally,  all  arrivals  in  a  busy  period 
(except  perhaps  those  in  the  last  inrerval  of  length  p.j-j)  are 
successfully  sent  in  tnac  busy  period.  Therefore  the  packet 
delay  has  an  exponentially  decaying  distribution  function  for 
.46'71  and  the  algorithm  is  stable. 

Tsybal;:av  and  Likhanov  C381  have  found  an  upper  bound  on 
deiav  and  more  recently  Huang  and  Berger  1393  have  constructed 
tigiit  upper  and  lower  bounds  as  well  as  si  mu.l  a  I:  i  on  results.  The 
expected  delay  is  about  5  1/2  slots  at  X  =  1 /e  and  about  16  slots 
at  X  =  0.46. 

The  FCFS  splitting  algorithm  can  be  improved  somewhat  if  the 
intervals  ere  split  in  an  optimal  way  after  collisions.  Because 
of  the  possibility  of  more  than  two  packets  in  a  collision,  equal 


suDincervals  are  not  quite  optimal.  Mosel y  and  Humblet  C403  and 
Tsybakov  and  Mikhailov  C37.1  show  that  choosing  the  optimum 
<=ub intervals  increases  the  maximum  throughput  to  0.4S7S. 

Recent Iv  another  improvement  of  3.6  10“^  has  been  made  by 

Vvedenskava  and  Pinsker  1141:.  Although  this  gain  is  small,  it  is 
of  theoretical  interest  since  it  departs  from  the  principle  of 
always  resolving  one  collision  before  trying  any  new  intervals. 

Considerable  effort  has  been  spent  on  finding  upper  bounds 
to  the  maximum  throughput  that  can  be  achieved  using  the 
assumptions  a)  to  e>  C42,  43,  44,  45,  46],  The  tightest  bound 
known  is  0.587  and  is  due  to  Mikhailov  and  Tsvbakov  C46]. 
Fippenger  s  result  1142]  is  also  of  particular  interest  since  he 
shows  that  if  the  amount  of  feedback  is  increased  to  give  the 
number  or  packets  involved  in  each  collision,  then  any  throughput 
up  to  one  o'ay  be  achieved. 

One  negative  aspect  of  FCF5  splitting  algorithms  (and  also 
Massey's  improvement  on  the  Tree  algorithms'  is  their 
susceptibility  to  noisy  feedback.  If  an  idle  slot  is  mistakenly 
fed  back  to  tne  transmitters  as  a  collision,  then  the  algorithm 
as  stated  will  forever  continue  to  split  a  smaller  and  smaller 
second  subinterval.  This  problem  could  be  solved,  of'  course,  by 
only  splitting  a  given  number  of  times  in  a  row  on  receipt  of  q 
feedback  and  then  trying  the  entire  interval.  The  general 
subject  of  noisy  feedback  is  still  not  well  understood,  but  a 
number  of  partial  results  are  known  C35,  47,  48].  The  review 
paper  by  Tsybakov  C4S]  also  reviews  many  variations  on  collision 
resolution  algorithms  for  a  variety  of  other  assumptions. 


The  splitting  algorithms  discused  so  far  require  all 


transmitters  to  sense  the  channel  feedback  at  all  times,  so  it  is 
interesting  to  investigaxie  algorithms  in  which  sensing  is  only 
required  atter  a  transmitter  has  a  packet  to  send.  Mathys  and 
Flajolet  C493  have  developed  an  algorithm  with  a  maximum  stable 
throughput  o+  0.4  that  has  this  limited  sensing  capability  and  is 
attractive  borh  -for  its  simplicity  and  robustness  against 
feedback  errors.  Very  recently,  Humblet  L553  has  shown  that  the 
FCFS  splitting  algorithm  can  be  modified  into  a  last  come  first 
serve  algorithm  which  also  has  this  limited  sensing  capability 
but  maintains  the  same  maximum  throughput  of  0,487. 

For  multiaccess  systems  with  a  finite  number  of  users,  it  is 
also  of  interest  to  modify  these  splitting  algorithms  so  as  to 
take  advantage  of  the  finite  number  of  transmitters  and  to  make  a 
araceful  transition  from  collision  resoii-ttion  to  TDI’lif  as  the 
arrival  race  increases.  Specific  approaches  to  this  are 
discussed  in  150.51.1,  The  approach  in  1511  is  also  interest 
because  of  drawing  a  parallel  between  splitting  algorithms  and 
croup  testing,  as  developed  in  the  statistics  community  in  tne 
4<.i's  and  50 's. 


We  now  want  to  chanas  the  basic 
assumptions  a)  to  e.i  .  Note  that  in  many  muJ.  ti  access  systems 
such  as  local  networks,  each  transmitter  can  hear  whether  or 
not  the  other  transmitters  are  ssndinq.  In  such  a 
situation,  it  makes  sense  to  qive  up  the  strict  slottinq 
specified  in  assumption  a),  and  assume  instead  that  a 
transmitter  can  start  to  send  a  packet  in  the  middle  of  a 
data  slot  if  no  other  transmitters  are  currently  senoinc. 
l''lot  only  does  this  allow  idle  slots  to  be  shortened,  bi.tt 
also  it  can  reduce  the  number  of  collisions..  Carrier  sense 
multiple  access  (CSMrt)  techniques  were  first  deyeloped  bv 
Kleinrock  and  Tobaqi  CSZl.  The  terminoloqy^  carrier  sense, 
does  not  necesss.rilv  imply  the  use  of  a  carrier,  but  simply 
the  abilif'.^  to  quickly  detect  use  o^  the  channel  . 

Let  c<  be  the  time  required  for  all  sources  to  Determine 
thaf  nothipq  is  beir.n  transmitted;  .i.e.,  o:  is  the  sum  of  the 
ma;;imum  propacat  1.  on  delay  between  s.ources  and  the  time 
"■•^rqui  I' ed  bv  a  I'ecei  •-'er  fo  re  i  .i.  distinouish  betws.^n 

.siqnai  ai  id  no  siqnal  .  Mssume  that  it  ncthinq  is  beinn 
transm.itteq  in  a  sJot,  tnen  that  siot  terminates  after  o: 
time  units  and  a.  new  slot  beqins.  We  still  assi.ime  that  all 
packets  require  one  time  unit  for  transmission.,  that 
feedback  is  i nstantaneous  at  the  end  of  a  slot.,  that 
arriyals  are  Poisson  with  intensity  and  that  there  are 
effect! velv  an  infinite  number  of  sources.  We  first  modify 
slotted  Aloha  for  this  new  situation  and  then  modify  the 
FCf'S  spl  i  tti  nq  al  qori  thm. 


'•i*\  ^  •w'-  ' 


fhe  ma-jor  difference  between  slotted  Aloha  CSMa  and 
ordinary  slotted  Aloha  is  that  idle  slots  now  have  a 
duration  a.  The  other  difference  is  that  if  a  packet 
arrives  at  a  source  while  a  transtTii  ssi  on  is  in  progress..  t.h 
packet  is  regarded  as  a  backlooged  packet  and  begins 
transmission  with  probability  p  after  each  subsequenr.  idle 
slot;  packets  arriving  durino  an  idle  slot  are  transmitted 
in  the  next  slot  as  usual.  This  technique  was  calle.d 
non-persistent  CSMA  in  C52J  t-o  distinouish  it  from  two 
variations.  In  one  variation,  persistent  CSMA,,  all 
transmission  attempts  during  a  bus-/  slot  would  simply  be 
postponed  to  the  end  of  that  slot,  thus  causing  a  collision 
with  high  probabilitv,  in  the  other,  P-per  =  :.  stent  CSMA, 
c.olHded  packets  and  packets  waiting  tor  the  end  ot  a  bus'-- 
period  use  different  probabilities  for  transmission,,  We 
ignore  tnese  '‘-ari  at  ions  in  wnat  to!  Mows  since  fnev  anoear  ti 
be  uniformly  interior  to  non-persistent  CCklH. 

lo  analvte  CCMA.,  we  can  use  a  Mai-ko'-'  Chain  again.,  i.isi.oi 
the  nufi'iber  ot  backlogged  packets  as  the  state  and  the  ends 
of  idle  slots  as  the  sta,t=  transiti-on  times.  Rather  than 
write  oi.i.t  the  state  transit  i-on  equrst i  one,,  which  are  not 
p-arti  cul  ar  1  y  insightful,  we  simoly  m-odifv  the  dri  it  in  iJ-.2 
for  this  new  model.  The  expected  number  of  arrivals  in  the 
idle  slot  before  a  given  transition  is  and  with 

probabilitv  1 -e” 1 -p  ,  this  is  followed  by  a  full,  slot 
with  >,  expected  arrivals.  Mote  that  there  is  always  a.n 
unused  idle  slot  at  the  end  of  each  full  slot,  but  we  count 


the  correspond!  nq  arrivals  as  part  of  the  -following 
transition.  The  model  could  be  changed  to  eliminate  this 
wasted  idle  slot,  taut  the  di-t-terence  is  negligible  for  small 
o;.  The  expected  number  of  departures  per  state  transition 
is  simply  the  probability  ot  a  successn  Thus  for  ki^-u, 

OilpLl , 

Dj^  ,  =  ['  1  —  e  i,  1  —p  .>  J 

For  >  I.  1 -i-o:;  \  1 .  this  is  minimized  over  p  ar. 

p  _  1  -  At. 

k  -  A  U (  4,,  12) 

For  k=0,  is  aiv(=n  bv  a  «.  H-o:,'  1. 1 „  which  is 
indeoendent  ot  p. 

■  The  stabilitv  issues  with  slotted  Hioha  CSM<n  are  almost 
the  same  as  with  ordinary  slotted  Aloha.  One  can  control  p 
bv  monitoring  the  teedback.  or  one  can  simolv  operate  a.t  a 
small  yalue  of  a  ana  p  and  hope  that  the  backlog  rarely 
becomes  too  large.  If  .-jg  use  the  optimal  value  of  p  for  each 

k..i  and  suostitute  this  in  \4..  ll.»,  we  -find  that  is 
negative  for  all  k.n.*  so  long  as 


-  1'  Ao:-tp  k  /  >.  1  -p )  .]  e  li 


(4. 1 1  > 


8v  expanding  (4.13)  in  a  power  series  in  1-a„  we  find 
that  for  small  o;  the  system  is  stable  for  all  a  less  than 
1  ->|2o:.  The  optimal  value  of  p  then  satisfies  pk  i|2o:.  It 


IS  intersstinq  to  observe  that  this  ootimal  point  occurs 
where  the  time  spent  on  idie  slots  is  approx i matel y  equal  to 
that  spent  on  collisions;  naturally  there  are  manv  more 
idle  slots  tnan  collisions,  but  idle  slots  have  a  much 
shorter  duration.  Delavs  also  tend  to  be  much  smaller  in  a 
CSMtt  svstem  since  backloqqed  packets  qet  a  transmission 
opportunitv  alter  everv  idle  slot,  and,  although  the 
probability  of  transmittinq  in  an  idle  slot  decreases  with 
ilo:,  the  probabilitv  o+  transmittinq  cer  unit  time  increases 
as  1/J«. 

Next  consider  CSHA  with  pure  Aloha.  We  will  not 

i 

analyse  this  in  detail,  btf^  si  mol  y  note  that  with  the  same 
carrier  ssnsinq  time  cc  and  the  same  transmission  probabilitv 
p.  the  probabilitv  ot  collision  increases  by  a  factor  o+  2. 
For  maximum  throuohput.  p  should  be  decreased  by  a  factor  of 
■I  i  Jesdinq  to  a  maximum  throuahout  oi-  l-2Jo:  for  small  o:.  Uii? 
see  that  the  di  ff erence  between  pure  end  sl.otted  Aloha,  +or 
CSHA  is  quite  small  for  small  o;?  m-reover..  the 
svnchrom.  zati  on  required  for  slottlno  w;i,  th  CSMa  is  somewhat 
trickier  than  that  for  ordinai-v  Aloha,.  Thus  pure  Aloha 
appears  to  be  the  natural,  cr.cice  with  C-Si-IA, 

f'inallv  consider  the  FCF3  splittinq  alqorithm  modified 
for  CSHA,  The  same  aiqorithm  as  in  |■4.4»  to  (4„7)  can  be 
used,  aLthouqh  the  parameter  should  be  chanqed.  and  as  we 
:=hal  1  see  shortly,  intervals  with  collisions  should  not  be 
split  into  equal  subi nterval s.  Since  collisions  waste  much 
more  time  than  idle  slots,  the  basic  allocation  interval  p< 


should  be  chosen  sms 11 .  This  means  in  turn  that  collisions 
w.Tth  more  than  two  packets  are  nealiqible.  and  thus  the 
analysis  is  simpler  than  betore. 

We  first  find  the  expected  time  and  the  expected  number 
of  successes  in  a  collision  resolution  period,  includs.  nq  a 
sinqle  idle  or  successful  slot  as  a  deqenerate  case  of  a 
collision  resolution  period.  Let  -i.  =  With  probability 

e  *,  an  oriainal  allocation  interval  is  emptv,  vieldinq  a 
i-ollisicn  resolution  time  of  o:  witn  no  successes.  With 
prcbabiiitv  'I'e  there  is  an  initial  success,,  yisldinq  a 
collision  resolution  time  l-i-o:  i.as  before,  we  includs  an 
empty  mini  slot  at  the  end  of  each  full  slot).  Finally,  with 
probabilitv  there  is  a  collision.,  yieldinq  a 

Cullision  resolution  time  ot  l-»-o:'+’r,  for  some  I"  to  be 
c=i,K.ul  a-.ted  later,  and  two  successes..  Thus.,  iqnorinq  the 
nrobabiJiry  ot  more  than  two  packets  i.n  a  cc.,'.  1  i  =5. .pn  . 


I£  ttime.'oeriod  ■  :::  as  +  a +o:.>  me'"^'  +  a  fo-i- f  •  2) 


( 4 ,  .14; 


Cl  ■.  p  ac  k:et  s  p er  1  od me  +■  .i  <  /  2  e  " 


<  4 ,  1 5  > 


«=  betoi-g,  the  maximum  achievable  throuqhput  f.or  oi  ••■en 
T-  IS  the  ratio  of  •4.  t.5»  to  i4,  14.)  , 


^max  ”  >;  1 -K-n-T)  3 


14.  .16) 


We  can  now  maximize  the  riqht  hand  side  of  (4.16) 


o\.'er  m 


n.  e.  over 


4.25 

In  the  limit  ot  small  o:„  we  oet  the 
asymptotic  expressions 

•P  ^  >j2o;/M  l-l;  \4.17:> 

I.  -  ^  2o:  U  ~  1  .•  I  4.  13) 

fit  CT  /\ 

l-inaily  we  must  calculate  I,  the  time  to  resolve  a 
collision  a-i-'ter  it  has  occurred.  Let  x  be  the  traction  of 
an  interval  used  in  the  first  subset  when  an  interval  is 
split-  The  first  slot  after  the  idle  slot  terminatino  the 
collision  is  idle,  successful,  or  collision  with 
orobab i  1  i  1 1  es  il-x  2:;v1-;!j,  or  x"^  resoecr. i  vel  v.  The 
exGscted  time  required  for  the  idle  case  is  o;-!- i  „  that  for 
the  successful  case  is  2  LI  ,  and  that  for  the  collision 
case  is  If o; ■+•  T .  I' h u s 

I  L  )  ■■  I  i:i:  i- 1  )  +■  4>m  1  .<  i  1  *-o:  >  +•  x  i,  1  to;  t-  f )  4  „  |,  > 

and  the  resultino 
Sub  5 1 1 1  ut  1  n n  t n  i  =  i  n 

•:4.  20) 

For  small  o:,  then.,  the  FCF3  splittinq  algorithm  has  the 
same  maximum  throughput  as  slotted  Aloha.  This  is  not 
surprising,  since  without  CSMA,  the  major  advantage  of  the 
FCFS  aloorithm  is  its  efficiency  in  resolving  collisions. 


T  1=  mini  mixed  b-’  x  =  -  r.;,, 

value  of  I',  for  s.tiali  o;,.  is  T  •-  2-tlo;.. 
(4..  .10).  wie  see  that 


■>2-1.' 


and  with  CSMA,  collisions  rarely  occur.  It  is  somewhat 
surprisinq  at  first  that  it  we  use  the  FCFS  algorithm  with 
equal  subintervals  (ie.  «=l/2),  then  we  are  limited  to  a 
throuohput  ot  l-i|3o:.  This  degradation  is  due  to  a 
substantial  increase  in  the  number  ot  collisions. 

The  same  type  ot  analysis  as  used  here  can  be  used  tor 
reservation  multiaccess  svstems  and  a  variety  ot  other 
conditions.  The  idea,  originally  due  to  Massey  L’531  and 
further  deyeloped  by  Humblet  C543  is  to  generalise  our 
original  assumptions  a)  to  e.»  to  allow  arbitrary  durations 
tor  idle,  success.,  or  collision  slots.  Recall  that  in  CSMA, 
idle  slots  had  duration  ■;<  and  success  and  collision  slots 
had  duration  It,.-,;,.  in  a  reseryation  system,  idle  and 
col. I  1  si  on  slots  would  hav©  the  duration  regiLired  to  send  a 
reservation  packet,  say  •:<,  whereas  success  slots  would  hay© 
duration  t+o:.  It  a  collision  resolution  algorithm  irUtn 
throughout  is  used  for  the  reseryati  ons then  is  ths 

e;:pected  time  tor  a  successful  reservation-  Thus  l.+o:..' -v»-  is 
the  ©K'pected  time  to  send  a  messaas,  ano  1 U +0:/ .^)c>  is  the 
throughput  of  the  system  using  reservati ons.  Suppose  a 
carrier  sense  system  has  the  ex-tra  property  that 
transmitters  inyolved  in  a  collision  can  derect  the 
collision  and  stop  transmission  within  o:  time  units  (as  in 
the  Ethernet  system).  Then  idles  and  collisions  each  have 
duration  a,  successes  have  duration  l+a,'and  the  throughput 
is  the  same  as  the  above  reservation  system. 
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Figure  1.1:  Multiaccess  Channel 

Figxire  2.2:  Multiaccess  Channel  With  Two  Transmitters 

Figure  2.2:  Rate  Region  of  Eqs.  (2. 3) -(2. 5) 

1  2 

Figure  2.3:  Output  y  ■  (y  ,y  )  as  a  Function  of  x,  w  for  Collision 
Channel  with  K  *  2 

Figure  2.4:  Achievable  Rate  Region  for  Collision  Channel 

Figure  2.5:  Achievable  Rate  Region  As  Function  of  Signal/Noise  A 

Figure  2.6:  Comparison  of  TOM  (as  modelled)  and  FDM 

Figure  2.7:  Regions  R.  Where  E  .  Dominates  Error  Bound;  for  A«1 
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Figure  3.1:  Timesharing  Construction  to  Obtain  Any  Achievable 
Rate  Pair  Without  Joint  Decoding 

Figure  4.1:  0^^  as  a  Function  of  X,p,k 

Figure  4.2:  Tree  Algorithm  for  Collision  Resolution 

Figure  4.3;  Record  of  a  Collision  Resolution  Period  for  FCFS 
Splitting  Algorithm 


Figure  4,4:  Markov  Chain  for  Collision  Resolution  Period 
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